Geospatial asset tracking systems, methods and apparatus for acquiring, manipulating and presenting telematic metadata

ABSTRACT

A convenient, easy to use ubiquitous governance system to help manage and maintain the plurality of semi-autonomous devices that will be loosely coupled to and communicate via the Internet or other network, more commonly referred to as the network of things.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a continuation of U.S. patent application Ser. No.14/295,030 filed Jun. 3, 2014; which claims the benefit of U.S.Provisional Application No. 61/830,502 filed Jun. 3, 2013; thedisclosures of each of which are incorporated herein by reference.

STATEMENT REGARDING FEDERALLY SPONSORED RESEARCH OR DEVELOPMENT

None.

FIELD

The technology herein further relates to convenient, easy to useubiquitous governance systems to help manage and maintainsemi-autonomous devices that will be loosely coupled to and communicatevia the Internet or other networks. As such, the technology hereinrelates to telematics, and more particularly to telematic and othersystems and methods for securely tracking assets including but notlimited to motor vehicles. However, this technology described here canmore generally be applied to secure embedded computing abilities to cureand delegate authorized processes to other secure processes.

BACKGROUND

Wireless connectivity is now ubiquitous. People are wirelessly connectedthrough their mobile phones, smart phones, tablets and numerous otherdevices and mechanisms. Yet, there are millions of “assets” that are notsimilarly connected. An “asset” can include any item or object of value.Motor vehicles, freight cars, trailers, containers, personal belongings,buildings, windmills, livestock, fuel tanks and certain persons are justsome examples of assets, as is almost anything else that has sufficientvalue to justify keeping track of where it has been and/or what hashappened to it. It would be highly desirable to provide an electronicpresence for each of those fixed and mobile assets for purposes oftracking, chain of custody and other reasons.

Telematics has been used for some time to track the geospatial locationof assets such as motor vehicles. One example fleet telematics solutionoffered by Networkfleet Inc. provides GPS fleet tracking, vehiclediagnostics, fleet maps, reporting, asset tracking, integration withexternal GPS devices, vehicle alerts and free roadside assistance.Compatible with light, medium, and heavy duty vehicles, the Networkfleetproduct line features two hardware devices. One device is GPS only,while another device connects directly to the vehicle's diagnostic portto continually monitor engine diagnostics. Both devices include a fastprocessor, built in accelerometer, and multi-port options. Both the GPSand cellular antennas are contained internally in the device, which canbe expanded to offer a total of 6 sensors to monitor voltage events likePTO, secondary engine, door, and other in-vehicle devices. The serialport allows for integration with compatible external GPS type devicesand also integrates with laptops and other devices. Remote vehiclediagnostics capabilities enable monitoring of diagnostic trouble codes,ignition status, speed, odometer, fuel efficiency and more. Anadditional “assert tracker” unit uses GPS technology to report locationand movement for field assets like trailers, generators, heavy dutyequipment or any valuable property. The battery life of this unit lastsup to three years, depending on the message configuration which can becustomized. The unit features hardened, sealed enclosures to maintainmaximum functionality in extreme weather conditions. Fleet managersusing Networkfleet's online application can view assets equipped withthe asset tracker unit on maps alongside vehicles in their fleet.Reports and alerts can be used to determine exact GPS location, if andwhen an asset has been moved, assets closest to a particular location orlandmark, geofence violations and other information. See for exampleUS20130116882 and www.networkfleet.com.

While such systems have been widely adopted and highly successful,further improvements are possible.

BRIEF DESCRIPTION OF THE DRAWINGS

Features and advantages of example non-limiting embodiments andimplementations will be better and more completely understood byreferring to the following detailed description of exemplarynon-limiting illustrative embodiments in conjunction with the drawingsof which:

FIG. 1 illustrates a geospatial asset tracking system such as theTEMEDA™ tracking system, monitoring several different types of assetsover a geographical area;

FIGS. 2A, 2B and 3 illustrate how example telematics devices can beapplied to different assets;

FIG. 4: illustrates how multiple telematics devices can communicate withone another;

FIG. 5 is a schematic diagram illustrating an example telematics device;

FIGS. 6, 6A & 8 schematically illustrate an exemplary illustrativenon-limiting embodiment of the geospatial asset tracking systemincluding an example server architecture;

FIGS. 7 and 7A show example non-limiting trust binding between atelematics device, a user device, a user and a centralized system;

FIGS. 9-10 provide an exemplary non-limiting diagrammatic illustrationof the flow of data for a device as it is being processed by theSpatial/Temporal Active GeoEncylopedia (STAGE) engine;

FIGS. 11-40 show example non-limiting user interfaces; and

FIGS. 41-42 show example security architectures.

DETAILED DESCRIPTION OF EXAMPLE NON-LIMITING EMBODIMENTS AND/ORIMPLEMENTATIONS

In the past, the price of telematics devices and the price of ongoingservices can be high. Additionally, currently offered solutions arerelatively complex in terms of what it takes to acquire data and dosomething with it, such as transmit, store and then retrieve and presentdata when the system user wants the way he or she wants it. It is notgenerally or always possible to predetermine how a customer willperceive value. Even within a particular customer, there are differentperceptions of value and different perspectives. Customers may thinkthey know what they want in such a system, but design based on whatcustomers think they want can often result in undue complexity andhigher cost. One desirable approach of non-limiting embodiments is tocreate a market not by giving customers what they want, but by givingthem what they need, while still allowing flexibility in a system forgrowth and change.

For example, it would be desirable in some example embodiments toprovide an example non-limiting system and solution that can grab oracquire any data elements from any time in the past that could developmeaningful information to any customers now.

It would also be desirable in some example embodiments to provide asystem wherein the primary human-machine interface for field units suchas in-vehicle devices is a smartphone or the like and where presentationinformation is presented in such a way as to be optimized for suchpresentation.

It would also be desirable in some example embodiments to provide a wayto remediate a device when something goes wrong with it. As price pointcontinues to erode and the number of devices increase significantly,service for a faulty device is likely to be cost-prohibitive. This makesit desirable to build recovery capability into the device itself.

It would also be desirable in some example embodiments toforward-integrate through data service and secure device management toturn the value chain over to the recipient. It would also be desirableto backwards-integrate through development planning, demand generationand demand fulfillment.

It would also be desirable in some example embodiments to providestandards and regulation compliance, telecommunications, hardware andsoftware that enables a customer's solution and helps manage customerand end user expectations, driving and sustaining momentum whileproviding low barriers to entry for even the smallest customers andfleets.

It would also be desirable in some example embodiments to provide atelematics system that establishes a secure binding between (a) atelematics device installed in or on the asset; and (b) an associateduser using (c) an interface device, for purposes of tracking chain ofcustody of the asset. Such chain of custody information can be valuablefor keeping track of where the asset has been and what conditions it hasbeen exposed to.

While several activity monitoring and management systems are alreadydeployed in the field, decision makers are often on the revenue side.“Assets” typically have long useful lives. Devices used to protect,track, monitor and otherwise interact with assets also need to last along time. A telematics or other monitoring device desirably in someexample embodiments will outlast a fleet vehicle (which generally isturned over every 3-5 years), will be rugged and will mask complexity tothe customer. Furthermore, the system will desirably in some exampleembodiments support the people operating the equipment to enable them todeliver people, services or products to their customers or otherwise.These people are, generally speaking, very interested in making surethat what someone bought has been delivered and can be efficientlyinvoiced. A smart handheld device such as a smartphone or the like canbe used in some example embodiments for the human interface to helpprovide an information model providing end-to-end processing from datareporting to invoicing.

It would be further desirable in some example embodiments to provide afunction to pull asset management as well as transaction processing datafrom a device(s) monitoring the asset so as to provide “assetmanagement” for “free”.

Such systems in some example embodiments will desirably provide basicinformation such as what, where, when (i.e., track and trace) as well asserving the needs of those running the business to deliver people,services and items to end customers. For example, time/location/velocitycan be communicated in some example embodiments to a data center whichcan also provide feedback for dispatch. Such functionality desirably insome example embodiments can be used to help mobile operations make andsave money, increase revenues, contain and reduce costs, improve safetyand security and ensure regulatory compliance. Advanced reporting (e.g.,just in time job operation) can desirably in some example embodiments beused to provide information based on gathered/monitored data in a waysuch that subscribers can get the information on their smartphone,desktop or any other convenient device.

Example Non-Limiting Feature Set of Example Non-Limiting Embodimentsand/or Implementations

Additional example non-limiting features and capabilities in someexample embodiments can include any or all of the following or anycombination thereof:

Multiple power arrangements

Multiple wireless capabilities

Ability to communicate with an in-vehicle electronic bus and getinformation

Useful with a whole range of assets, including non-powered and powered

Address heretofore unserved parts of the market

Logging (miles, fuel)

Track and trace

diagnostics

vehicle navigation (turn-by-turn navigation and mobile directions)

Asset utilization; asset may be a “container” used to deliverpeople/products/services

Dynamic scheduling and dispatch

chain of custody (e.g., where the asset has been, where it is now, whathas happened to it, who has interfaced with it)

Remediation mechanism that allows the system to bring devices back to aknown condition

Programmability including OTAP

Offer integrated scheduling and dispatch

Managed adaptable trust engine

highly user customizable

easy to provision and activate

Programmable on the fly

Use of data about telematics data for delivering resilient networking

rugged hardware/item of manufacture

software as an extension

can interface with a vehicle or other signal and/or control bus toreceive and process signals provided by the “asset”; show vehicle datafrom the bus on a user interface “breadcrumb trail”

can provide a local area mesh or peer-to-peer sensor node networkmonitored and controlled by wireless WAN communication hub; such networkenables e.g., temperature monitoring throughout for example the cab andtrailer of a tractor-trailer combination; light detection to alert whenand where the trailer has been opened; in addition to measurement ofother environmental factors including but not limited to humidity,radiation, carbon monoxide, other.

“track and trace”: monitor geospatial location of assets, theircondition, speed, and assets that have either already left a location orentered one or to provide warning prior to entering or leaving alocation

Can monitor driving patterns including speeding, fast starts, suddenstops, excessive idle zone, battery level, speeding alerts

Communication through a common interface

Any kind of connectivity—any network transport can be used

AAA: access authentication

Geolocation—lat/long for google or other map lookup

API that allows integration with any third party

“curation”—friendly application environment permitting applications thatmeet device policy but barring applications that do not by means ofe.g., a digital signature for identification of authentication andintegrity of said applications

End to end security—from trusted mobile entity all the way to the endcustomer-user—on both ends. That is, the operator with custody of thedevice in the field is authenticated to the system as is theoperator/dispatch manager at the web based console

The mobile entity is itself “tamper-evident” and “tamper-resistant” withability to transfer intrusion information to the service including “lastgasp” power capability in case power is disconnected

Scripting engine, separate from operating system

Specific policies may be applied that bring together input data fromvarious environmental sensors combined with both the space and time forthe asset

Dynamic delegation enables devices that are bonded in a trusted fashionto share resources. For instance, if the cellular connection in thetracking device fails, it may make use of the cellular connection in thebonded smartphone. Devices may share certificates issued by a commonCertification Authority (CA), with policy and hierarchy tables. Policytables indicate the functions they are capable of, functions they mayreceive a delegation request for and finally the condition that willpermit the requesting device to delegate a function to the performingdevice. Hierarchy tables detail the direction of delegation, and thegranular permissions associated with each function.

Telematics hardware device mechanically securely fixed or otherwisebound to the “asset”

Device is securely virtually “bound” to a human who is currentlyassociated with the asset

Relationship between this device and the human will establish a trustbond

Device constitutes an intelligent agent that will serve the system

Entity that establishes credentials—based on context (where, when) itwill serve.

Authenticated audit log of time and space. A spatial time stamp in theform of latitude, longitude, and altitude is combined with a time anddate stamp. Sensory elements are included, including data from thevehicle bus, radio signal strength and other environmental sensors.These elements are digitally signed using the system private key. Thelog ensures data integrity and authenticity of origin.

A program running in these devices makes them appear to be anappropriate device; the person authenticates, and then his or heridentity is used for security.

Intelligent Communicating entity bindable to an asset (e.g., could behardware mechanically fixable to the asset, or a secure software entitythat is authenticated to a user)

Trusted Intelligent Agent executes on the trusted entity

Agent gathers information from a sensor that monitors the asset (e.g.,geolocation, operation and/or condition of the asset e.g., vehicle bus,biometrics of the user)

Binding/trust bond of asset to asset. Each device has an immutable,permanent, statistically unique identifier. This UID is exchanged in theestablishment of the trust bond. Each device has a table that listsother UIDs that is bonded to it. This data is protected frommodification by signing the information ensuring authenticity and dataintegrity.

Binding or trust bond between the user and the user's device; betweenthe user's device and the asset's device; and between the user and theasset's device. In this case, the UID of the user is the fingerprint ofthe biometric. As in the asset to asset case above, the biometricfingerprint is signed and protected. As required, or on a periodicnon-intrusive collection the device will assess the relevant biometricfingerprint of the human in proximity to the device and compare to theone that is stored in protected storage.

Enables system to continually securely monitor geospatial location,environment and interactions (e.g., chain of custody) of the asset overtime

Proximity-based binding based on overlapping geo-fences. The GNSS sensorin each device establishes a spherical, configurable geo fence of radiusX. With an overlap of a configurable amount, Y% of the two geofencecircles an assumption of proximity may be concluded. Another case is onewhere neither device has a GNSS sensor. Proximity may be concluded usingReturn Signal Strength Indicators (RSSI). At a specific signal strengthor higher, it may be concluded the devices are in proximity. GNSSsensors with geofences may be combined with a non GNSS enabled device toenable a hybrid method of proximity detection.

Use of a user's own device sensors to create a trust bond with theembedded device

Telematics entity can be remotely securely dynamicallyupdated/maintained/extended

Can leverage the user interface of an external device (e.g., smartphone)

Hardware pre validates the software environment as the first step of thepower on self-test

Once the trusted environment is operational, continual validation isperformed after-the-fact for health and sanity check.

Devices receive signatures of known infected devices. If a device comesinto contact with one of these infected devices, it broadcasts the UIDof the infected device to all conforming devices in proximity and alsoinforms the backend system. It will include additional identifyingmetadata, for example, the location of the infected asset, any uniqueidentifiers, what radio bearers they have in operation etc.

Devices may also be able to detect if another device is infected basedon conformance to policies. A device violating polices encapsulated incode on the healthy device will be identified as a candidate for aninfected device. It will prompt a closer inspection by the backendsystem.

Device not acting in accordance with a described healthy device can bequarantined—conforming devices will not communicate with a quarantineddevice—and then remediated by a side channel that can be reinitializedin accordance with secure mechanism to bring the device back to life.

A defensive node can be transformed into an offensive mode (using thesystem to disrupt an existing infrastructure). The system becomes theattacker rather than one susceptible to attack.

Frequency analysis and correlation on an engine or class of engines,based on rpm and other attributes; correlate to vehicle to identifyundocumented OBD (on board diagnostic) or other vehicle (asset) buscodes.

Dynamic definition of behavior of the device based on a set of factsfrom an asset to define an agent that is going to take an action. Use ofhistorical data to generate an alert to detect variance between plannedand actual.

Self-remediation and propagation of instructions to self-diagnose andpeer-diagnose; one device is granted the ability by policy to remediateother devices within its proximity

Alerts generated by the embedded device to indicate the device needsremediation

Downloading a plan to an embedded device in real time. Plan can includenavigational route, preset threshold limits for sensor readings atspecific locations. For example, vehicle speed threshold will bedifferent in different geographical regions (e.g., driver safe drivingmay have tighter tolerances in schools zones). For example, thresholdlimits can be set for each and every sensor (camera, light, microphone,accelerometer, radio signal strength) etc. Logic for the integratedthreshold values may be validated at each geo-spatial node on a route.For example, at position x, at time y, accelerometer readings should bewithin these particular parameters, the driver should be person Z asauthenticated by voice (microphone), iris (camera) and perhaps also akey transmitted in light pulses from his/her smartphone to telematicsdevice.

Customer can receive in one monthly price device, software solution(hardware as a service) which includes data services—low barrier toentry because hardware is a service

Integration of novel STAGE architecture to pump into other third partysystems

High degree of granularity and visibility based on tracking both theuser and the asset

Secure self-healing mesh node network

Server can detect intrusions and tampering

Monitoring of trucks and the like as IT assets

Integration to provide a more comprehensive alternative

Example work order handling from a customer back office can involve atracking device, a vehicle and a person with a smart phone. These arebound in a trusted relationship to authenticate that a desired actionwas performed. The smartphone is capable of bringing all these togetherbased on sensors to record spatial, temporal, asset and environmentalconditions. The smartphone has dedicated software to general public keypairs and have the public signed into the format of a certificate by aCertificate Authority. The customer back office can digitally sign thework order to ensure integrity and authenticity of the work order, andthereafter encode the details of a work order into a two dimensionalsymbol. This can be read by the camera of the device and the dataextracted, and the digital signature verified using the public keycertificate on the smartphone described earlier. This provides all theinformation in the work order. The camera reads the 2D or otheridentifying symbol or other information from the hardware device andbrings in its ID and other unique information. It is also possible totake a picture of or otherwise acquire the VIN or other vehicle/assetidentifier via the OBDII (On Board Diagnostic II) or other port toprovide another source of data. Biometric sensors can capture iris,voice, facial patterns, etc. to provide multifactor personalauthentication. The GPS/GNSS system also provides space (location) andtime. This is packaged into a file format, signed with the private keyand uploaded (e.g., wirelessly) into the database to provide anintegrated report resistant to tampering with known authenticatedorigin.

A registration process is used beforehand to establish the keymanagement and register individual users (e.g., capture biometricsinformation).

One-to-many relationship between vehicle and workers (e.g., binding canchange shift by shift); applications may include a “car to go” (zipcar),car rentals (binding users with rental cars) or other spontaneous,changeable and/or ad hoc asset binding.

Telematics device and SmartPhone are in Peer-to-Peer communicationsession (“Peer-to-Peer” can be over WWAN, WLAN, WPAN or any othercommunication link)

SmartPhone knows Human/Driver has established a trust bond throughmulti-factor authentication (some shared known by the user, somethingthe user has possession of, and something the user “is” that is somebiometric validation. E.g. fingerprint, iris etc).

Telematics device does not know human/driver, however, may be informedof driver through alternative session service outside of thePeer-to-Peer

Human/Driver Biometrics—continuously harvested through theChallenge-Response Protocol with Driver and SmartPhone—and alsoharvested by overall system in the Driver enrollment process—may be usedto create new seed for new pseudorandom Peer-to-Peer communicationprotocol(s)

Pseudorandom Peer-to-Peer communications protocols may be as simple orcomplex as WWAN—then—WLAN—then—WPAN—then WPAN—thenWLAN—then—WPAN—then—WWAN—etc. (i.e., using multiple parallelcommunication paths interleaved with one another for evasion).

Can be used in addition to employing dynamically updated encryption asthe Peer-to-Peer transport changes with a perpetual feeding ofEncryption Key data for a particular transport out-of-band through oneof the other transports (e.g., WWAN keys sent over WPAN, WPAN keys overWLAN, WLAN keys over WWAN, etc.).

Using light as an additional bearer of any information by leveraging thefact the smart phone has both light emitter (flash) and light sensor(camera). Non-limiting examples include use of the hardware device LEDsand light sensor for communication of authentication and challengeresponse protocol with a smart phone using the smart phone's flash andcamera as part of the authentication and challenge response protocol.

Use of simply coding such as Morse code or even a dynamically mutatingprotocol that uses the wireless WAN connection as a means to educateboth Nodes as to the interpretation of the mutating protocol.

Means to transfer a secret key that can only be intercepted via man inthe middle/line of sight to avoid security risks presented by Bluetooth,WIFI, NFC, RFID or any radio protocol that can be intercepted from adistance using hi gain equipment.

MATE—Managed Adaptable Trust Engine (on telematics device)

TEAM: Telematics Extensible Application Module

TEE: Telematics Execution Engine

TSB—Telematics Service Bus: disposed in cloud but partly alsodistributed; supports dynamic instantiation of Intelligent Agents atboth server and device, Extends and compliments data acquisition andcontrol from remote asset (mobile and fixed). Provides ability to moreeasily integrate with customer ERP systems.

STAGE—Spatial Temporal Active GeoEncyclopedia (data store): part of theTSB; Queries enable derivation of values for “ActionableIntelligence”—enables intelligent agents at TSB and TEAM environments toexecute Intelligent Actions

PLANT—Process Layout And Navigation Tool

TCOC—Trusted Chain of Custody may be pre-planned through a PLANT, may beused to capture an initial baseline PLANT that will be introduced to asa starting point for documenting and formalizing processes that can bememorialized and managed

TCOC makes use of the continuous data harvesting on the device and theassociated authenticated log. Triggers may be enabled, for example, tosend an alert if velocity exceeds x mph for y minutes.

A smart phone app can be used to manage device install onto an asset.This allows the owner to have a management tool to self-manage theinstallation. The client purchasing the system can use this installationapp on the smartphone to manage the installation. The app takes thefield data related to installation and provides it for incorporationinto the database. The device can take a picture of a one or twodimensional symbol, or use Bluetooth to access the device, or type in anidentification for the device, or by other means. The installer canprovide authorization based on serial numbers associated with theinstallation job. Meanwhile, the mobile device can obtain variousinformation including the VIN or other ID from the vehicle/asset itself,tag number or other more commonly-used identifiers for the asset.

A business owner may have their specific applications leverage the trustbond between worker, smart device and asset. The trust bond combinedwith the authenticated log provides a high level assurance that workersand assets are in proximity, and records vehicle, system andenvironmental factors recorded. Such functions manage personnel (e.g.,creating, adding, editing and deleting workers). This also permitspersonnel management by viewing a breadcrumb trail, set exceptiontriggers, ping workers, get real-time status, find nearest, view workerson a map, etc. Installation tokens can be issued on provisioning orissuance of a ticket. This also allows schedule and dispatch to assignan installer to do the installs, monitor work progress, etc. Thisprovides an active engaged environment so the owner knows exactly whatis happening when and can see progress, conditions and potentialproblems in near real time.

Busy small businesses out in the field themselves can performconfiguration and monitoring on their own smartphone or other mobileinterface.

The worker's screen may provide a different user interface than amanager's interface in an example non-limiting implementation. Aparticular worker is bound to the electronic device in the vehicle orother asset to thereby assign a driver to a particular vehicle via asmart phone. The workers can also see who else is in the field and wheretheir reports are (if they are a supervisor for example). Workmanagement can provide for dispatch and work assignments. Suchscheduling and dispatch confirms arrival location at the customerlocation. The worker can report what they are doing in real time withtheir smartphone.

The third party installer can become a worker during the install, andcan be tracked by the system. This enables the third party to be trackedand to track for the duration of the trust bond between worker, smartdevice and asset.

Device synchronization for permissioning: There is logging associatedwith a smartphone being married with an installed telematics device orentity. Possible to synchronize and link, using a Bluetooth or otherinterface, the user with the device.

Worker functions include entering worker information such as byproviding a token for install. A smart phone application can bedownloaded, and the device can be synchronized for provisioning.Individual driver assignments can be provided for the mobile device andmobile interface device synchronization. Users can be granted access tothe mobile device user interface. Users are authenticated to the TeMeDasystem and keyspace as are their smart device and the asset beingregistered.

Mobile applications can be used to integrate GPS tracking with workmanagement and remote collaboration. The application on the mobiledevice can provide additional functionality to the worker in addition toGPS/GNSS geospatial information. Workflow control can be provided bysuch a mobile app. Location, communication and back office functions areall supported in an integrated manner.

As discussed above, it is possible to bind assets together (e.g.,trailer to tractor, etc.) allowing the system to track both the personand the asset(s). Placing an active tracking device in a truck or otherasset provides continual monitoring of any asset (powered ornon-powered).

GNSS or other geolocation in both the mobile device and the worker'sdevice can be used in conjunction with proximity detection via GNSSoverlap and/or by ability of the two devices to communicate.

Binding is between the user and the user's device, and between theuser's device and the asset's device.

The user interface provides a visual tool that pulls data in from anend-to-end system.

Scripting language allows the end user to be other than the developer. Avisual diagramming tool can be used to develop the scripts for executionby the device that is bound to the asset. Visual flowcharting interfaceallows anyone to develop scripts for the embedded device in the asset.The scripts can be linked with scheduling so that new scripts can bedownloaded on an as-needed basis. There is no need to download firmwareupdates to provide such dynamic functionality. These scripts canincorporate all inputs relevant at every geo-spatial location on aparticular route.

Any type of sensors can be used (infrared, vibration, etc.) or added andconnected to the embedded device. A number of nodes can be created alongthe destination to ensure that all parameters are correct. Scripts canbe downloaded over the air into the embedded device on a dynamic basisbased on the instantaneous context of the asset in real time based onevaluation in real time of the current state/context of the asset (e.g.,GNSS geofence, but also a wide array of sensor data depending on the usecase). Decisions can be made in the embedded asset device based on astatic PLANT. The asset device dynamically determines whether there arevariances to the static plan and can take appropriate action.

Example non-limiting systems, apparatus and methods for associating withan item may comprise a processor disposed and structured to receiveinputs from at least one sensor; and a non-transitory memory devicestoring instructions that when executed by the processor provides atrusted engine that develops and maintains a secure, trusted chain ofcustody with respect to the activities associated with delivery ofpeople, products and/or services.

In some example embodiments, a device housing is bound to an asset,wherein the processor is disposed in the housing. The memory device maystore further instructions that when executed by the processor securelymanages and executes applications. At least one sensor may comprise ageographical locating sensor and/or a biometrics sensor. The processormay be structured to securely receive inputs from at least one sensorover one or more wireless links. The processor may be structured tosecurely authenticate and bind with an additional portable deviceproviding said at least one sensor. The processor may be structured toreceive inputs wirelessly from the at least one sensor disposed in ahandheld device. The processor may be structured to be securely managedand monitored remotely, and may execute secure intelligent agents of aremotely located management entity.

Example Non-Limiting System Architecture

FIG. 1 shows an example non-limiting geospatial asset tracking system(such as the TeMeDa™) system used within a cityscape 100 includingassets. In this particular non-limiting example, the assets showninclude a delivery van 102, a tractor (cab) 104 pulling a trailer 106, atrain engine 108 pulling freight cars 110, and a fixed storage facility112. However, these assets are merely non-limiting examples for purposesof illustration. Assets can be virtually any item, object or person. Forexample, assets are things, objects or living things that may be fixed,moveable or moving; large or small; vehicular or non-vehicular; animateor inanimate; operated by or otherwise associated with a human user ornot; capable of carrying or containing other objects or not; valuable ornot; indoors or outdoors; active or passive; self-powered, externallypowered or unpowered; electronic or mechanical; singular or in sets;interactive or not; programmed, programmable or not; possessing anyother desired characteristic; or any combination of the above.

In the non-limiting example shown, each asset 102-112 has at least onetelematics device 150 associated therewith. Thus, delivery van 102 has atelematics device 150 a installed on board; tractor 104 is equipped witha telematics device 150 b and trailer 106 has a telematics device 150 conboard; train engine 108 has a telematics device 150 d; each of freightcars 110 has an associated telematics device 150(e-h); and fixed storagefacility 112 is provided with a telematics device 150 i. Telematicsdevices 150 can have different configurations and capabilities. They maybe integrated as part of the asset at the time the asset is manufacturedor added to or installed in the asset later. They can be powered by theasset, self-powered by their own internal power source, or powered froman external source such as sunlight, kinetic energy, electromagneticfields or other source. They can have more or less capabilitiesdepending on the application, use or customer need.

In this example, telematics devices 150 each have the capability tocommunicate information. Such communications can be wireless or wired,continual or intermittent, verbose or compact, periodic or non-periodic,digital or analog, one-way or bidirectional, single-mode or multi-mode,optical, radio, or any combination of the above. In one examplenon-limiting example, each of telematics devices 150 is equipped with awireless electromagnetic transceiver that communicates digital data overconventional electromagnetic frequency bands such as the 900 MHz, 1800MHz, 2.4 GHz and other bands using cellular telephone, Bluetooth, WiFi,WiMAX, or any other conventional communications technique or combinationof multiple such techniques. Such communications capabilities allowtelematics devices 150 to report and receive information at desired timeintervals and/or circumstances. Such information reported and/orreceived can be any kind of information including but not limited toinformation concerning the geospatial location, environment, stateand/or status of the telematics device 150. For example, telematicsdevices 150 can report geolocation or other location-based informationsuch as GNSS (Global Navigation Satellite System); acoustic, soundand/or vibration; automotive and/or transportation; chemical; electriccurrent, electric potential, magnetic, radio; thermal, heat, and/ortemperature information; environment, weather, moisture and/or humidity;flow and/or fluid velocity; ionizing radiation and/or exposure tosubatomic particles; navigation instrument information; position, angle,displacement, distance, speed and/or acceleration; optical, light,imaging and/or photon information; pressure information; force, densityand/or level information; proximity and/or presence information; or anyinformation concerning any other sensed or other properties, conceptsand/or characteristics affecting, in the environment of or otherwisesensible by the telematics device. Telematics devices 150 can alsoreport information acquired from human users including but not limitedto speech, commands, touch inputs, button presses, biometrics, facialrecognition, heart rate, sleep state, eye movement, blood alcohol level,reaction time or other physiological information; or any otherinformation acquired from a human or other living thing.

Telematics devices 150 can receive commands, control information,programming, software, state change information, instructions, statusinformation, visual and/or audio information, or any other kind ofinformation. In the example non-limiting embodiment, telematics devices150 can communicate with any desired type or configuration of externaldevice(s) including but not limited to smart phones, tablets, computers,cellular telephone systems, the Internet or other network, humans,and/or other telematics devices.

FIGS. 2A, 2B, 3 and 4 show example non-limiting example scenarios. InFIG. 2A-2B, a telematics device 150 a is installed on-board delivery van102. The telematics device 150 a can be fixedly installed and bonded ina trusted way to the van 102 so that it remains with and travels withthe van wherever the van goes. In this particular non-limiting example,telematics device 150 a communicates wirelessly via Bluetooth or otherconventional RF communications with a smartphone or other user interfacedevice 152 operated by a human driver 154. Such information exchange(which can be wired and/or wireless) permits telematics device 150 a toexchange information with one or more applications (“apps”) executing onor otherwise provided by user interface device 152. Such informationexchange permits telematics device 150 a to leverage and use sensing,displaying, transducing, computation, storage, communications and/orother capabilities provided by user interface device 152 to interactwith user 154 and/or for other purposes. Thus for example, the user canuse the user device 152 for conventional telephone calls, texting,emailing, and the like. Telematics device 150 a may interact with anapplication installed on the user device 152 to permit the user tointeract with the telematics device. As will be discussed below, suchinteraction between telematics device 150 a and user device 152 canprovide trusted bindings or bonds to reliably and securely establishtrusted associations between devices and other devices and/or people.Such trusted bindings are highly useful for knowing where the asset hasbeen, what has happened to it, where it is now, etc.

Additionally, as illustrated in FIG. 2B, telematics device 150 a maycommunicate with equipment, sensors, processors, memories, devices orother capabilities on-board the asset (in this case van 102). In theparticular example shown, van 102 includes a conventional OBD-IIon-board diagnostic system including a digital bus accessible via aconventional connector. In the non-limiting example shown, telematicsdevice 150 a includes a wired or wireless capability (e.g., a connector156 and associated cable) for interfacing with such on-board vehicledata bus. Using such connection capability, telematics device 150 a mayreceive/monitor various information concerning van 102 including but notlimited vehicle speed, engine RPM, fuel level, and a variety of othervehicle operating parameters. Additionally, in some example non-limitinginstallations, telematics device 150 a may apply signals to the van102′s bus to control certain aspects of the asset, access the asset'sinternal user interfaces (e.g., dashboard display, sound system, etc.)and for other purposes. Of course, the technology is by no means limitedto an OBDII vehicle or asset bus and can be used with any on-assetcommunications or network capability(ies) including but not limited toCAN (Controller Area Network), D2B (Domestic Digital Bus) FlexRay,DC-BUS, IDB-1394, IEBus, I²C, ISO-9141-I/-II, J1708, J1587, J1850, J1939and ISO 11783, KWP2000, LIN (Local Interconnect Network), MOST (MediaOriented Systems Transport), Multifunction Vehicle Bus (part of theTrain Communication Network IEC 61375), SMARTwireX, SPI, VAN (VehicleArea Network), WIFI or any other desired communications facility andassociated protocol. Some such busses may also provide power fortelematics device 150.

FIG. 3 shows another example installation configuration where atelematics device 150 b is installed in/bound to tractor (cab) 104, andanother telematics device 150 c is installed in/bound to trailer 106 ofan 18-wheeler, semi or other large vehicle. In this particular case,because tractor 104 is not necessarily permanently attached to orotherwise associated with trailer 106 but rather is designed so that thetractor can pull any trailer and trailer 106 is designed to be pulled byany tractor 104, it is desirable to use separate telematics devices 150b, 150 c to provide separate points of presence for these two distinctassets.

In this particular example, telematics device 150 b may be connected toa J1939 9-pin diagnostic port connected to a CAN bus of tractor #104 tomonitor engine operation, vehicle speed, vehicle braking, enginetemperature, engine RPM, vehicle braking, vehicle distance, vehiclewheel information, fuel economy, ambient conditions, water in fuelindications, inlet-exhaust conditions, shutdown, diagnostic troublecodes, etc. Telematics device 150 b may further include internal sensorsincluding but not limited to a GNSS receiver, an accelerometer or othervibration or motion sensor, a temperature sensor, a sound/noise/speechsensor, or other sensors providing information for processing, loggingand/or reporting by the telematics device.

In the non-limiting example shown, telematics device 150 c installed ontrailer 106 may not need to connect to any other facility or capabilityprovided by trailer 106, but may be self-sufficient and/or self-reliantin terms of being self-powered, self-sensing, self-aware and the like.In the non-limiting example shown, trailer telematics device 150 c andtractor telematics device 150 b can automatically detect that they arein proximity to one another, establish wireless communications exchangeover a wireless communications link, and leverage and/or otherwisecoordinate each other's sensing, processing, storing, reporting and/orother capabilities. Such coordination can further involve a user device152 as shown in FIG. 2A.

Example Non-Limiting Inter-Device Communications

As shown in FIG. 4, such inter-device communications and coordinationbetween telematics devices 150 can be scaled and expanded to involve anynumber of such telematics devices communicating in a chained network; adhoc or other mesh network; one-to-many, some-to-many or many-to-manynetworks; or any other network or communications type or style. In suchinstallations, it may not be necessary for each telematics device 150 toinclude long-range communications facilities. For example, some suchtelematics devices 150 can acquire and store/log data and rely on itsshort-range communication with other devices in communication therewithto communicate the stored data over longer distances. In still otherexample non-limiting embodiments, each telematics device 150 can acquireand log information, and then report logged information (or processedversions thereof) intermittently when in range of or otherwise connectedto an external network, station or other authorized device.

Example Non-Limiting Trust Bindings

In the non-limiting examples shown, telematics devices 150 can bephysically and/or virtually bound to assets, humans, other telematics orother devices and/or centralized or other reporting systems. Forexample, in the FIG. 2A/2B non-limiting example, telematics device 150 ais physically bound to van 102 by gluing, bolting or otherwise attachingthe telematics device to the asset. In some example non-limitinginstallations, attempts to remove telematics device 150 a from the assetmay result in destruction, disablement, alert generation or other statechange of the telematics device. Meanwhile, a virtual binding or trustbond may be established between telematics device 150 a and smartphone152, and a further virtual binding or trust bond may be establishedbetween telematics 150 a and user 154. Such non-limiting examplebindings are illustrated in FIG. 7. In the example shown, lines 170indicated by “*” show secure trust bindings. In this example, atelematics device 150 a providing GNSS geolocation information(latitude/longitude/time) can be bound (see binding 170 a) (for exampleusing a password or other challenge; biometrics including but notlimited to facial recognition, fingerprints, voice recognition, iris orretina recognition, or other single or multifactor biometricauthentication technique; or by other means) to a user 154. Thetelematics device 150 a can, in addition or alternatively, be bound to auser device 152 using cryptographic, digital signature or otherauthentication means or protocols. Telematics device 150 a may also bebound (see binding 170 b) to vehicle 102 (e.g., by reading a vehicleidentification number from an OBDII or other vehicle bus or network, byusing the camera 174 of user device 152 or other sensor to recognize aone or two dimensional symbol or other optical code affixed to thevehicle 102; and/or by using proximity detection based on receivedsignal strength (RSSI), geolocation (GNSS) affixed to the vehicle, orother capability to ensure that the vehicle 102 and the telematicsdevice 150 a are co-located or in close proximity to one another.

In one example non-limiting embodiment, the SmartPhone 152 knows theHuman/Driver 152 (i.e., person authenticated to it). The telematicsdevice 150 a does not know human/driver, but may be informed of thedriver through alternative session service outside of the Peer-to-Peer.Human/Driver biometrics 172 is used to continuously harvest biometicinformation concerning driver 152 through a Challenge-Response Protocolwith the Driver and SmartPhone 152 to establish a trust bond 170 a. Suchbiometric information could also or alternatively be harvested by theoverall system in the Driver enrollment process, and may be used tocreate a new seed for new pseudorandom Peer-to-Peer communicationprotocol(s).

Pseudorandom Peer-to-Peer (PPP) communications protocols may be assimple or complex as WWAN Carrier#1—WWANCarrier#2—then—WLAN—then—WPAN—then WPAN—thenWLAN—then—WPAN—then—WWAN—etc. (e.g., using multiple parallelcommunication paths interleaved with one another for evasion). Suchcommunications can be used in addition to employing dynamically updatedencryption as the Peer-to-Peer transport changes with a perpetualfeeding of Encryption Key data for a particular transport out-of-bandthrough one of the other transports (e.g., WWAN keys sent over WPAN,WPAN keys over WLAN, WLAN keys over WWAN, etc.). PPP communications alsoexpand the effective coverage for a device as it is able toopportunistically use bearers as and when they are available. Forexample, if the device leaves coverage area of one Carrier (e.g. #1) itmay automatically switch to the next available carrier.

It is also possible to use light as an additional bearer of anyinformation, leveraging the smart phone 152 light emitter (flash) andlight sensor (camera) 174 capabilities. Non-limiting examples includeuse of telematics device 150 a LEDs or other light or radiation emittersand a light sensor for communication of an authentication and challengeresponse protocol with a smart phone 152 using the smart phone's flashand camera as part of the authentication and challenge responseprotocol. Morse or other coding using a dynamically-mutating protocolover a wireless WAN connection can be used as a means to educate bothnodes as to the interpretation of the mutating protocol. This canprovide a means to transfer a secret key that can only be interceptedvia man in the middle/line of sight. This can be used instead of or inaddition to Bluetooth, WIFI, Near Field Communications, RFID or anyradio protocol to increase trustedness of a continual trust bond. Ofcourse, if lesser security is tolerable, any other protocols ortechniques could be used alternatively or in addition.

In one example implementation illustrated, a work order comes from acustomer back office. A telematics device 150 a, a vehicle or otherasset 102 and a person 154 with a smart phone 152 are bound in a trustedrelationship to authenticate the action that was performed. Thesmartphone 152 is capable of bringing all these together based onsensors and also a PK Public-Private and/or symmetric cryptographicpair. The customer back office can encode the details of a work orderinto a 2D or other optical symbol. This can be read by the camera 174 ofthe device and the data extracted. This provides all the information inthe work order. The camera 174 reads the 2D symbol from the telematicsdevice 150 a and brings in its ID and other unique information. Thecamera 174 can also take a picture of the VIN or other vehicleidentifier. The telematics device 150 a connects to the OBDII on-boarddiagnostic or other port of the vehicle to provide another source ofdata. Biometric sensors 172 can capture voice, facial patterns, etc. toprovide multifactor personal authentication. The GPS system alsoprovides space (location) and time. This is packaged into a file format,signed with the private key and uploaded into the database to provide anintegrated report with an authenticated log of events, locations, andsensor readings. A registration process can be used beforehand toestablish the key management and register individual users (e.g, capturebiometrics information).

Since there is a one-to-many relationship between vehicle and workers(e.g., binding can change shift by shift), each new driver of thevehicle 102 can be bound to the telematics device 150 a in turn.Telematics device 150 a and SmartPhone 152 may be in a Peer-to-Peercommunication session over WWAN, WLAN, WPAN or any other communicationlink.

FIG. 7A shows an example non-limiting flow of trust between exampleentities that participate in a normal relationship with the device/asset150. As will be understood, a number of external interfaces of FIG. 7Aare not shown but rather are described in more detail elsewhere in thisapplication. The top right of the drawing indicates a closed loopsystem—as indicated elsewhere herein, the chain of custody can encompassthe entire life cycle of the device/asset 150 from creation toretirement or destruction. The relationship may be broken into at leasttwo pieces (depicted by the dotted line). One example trust relationshipallows the manufacturer or other authorized person or entity toremediate the device back to a known good state. There is a second trustrelationship that is transferred from the manufacturer, through theretailer to the owner/operator. This allows the owner/operator tomanage, configure and/or modify the operation of the system to theirneeds, but in one example non-limiting arrangement, not affect the corecomponents of the system. If the hardware malfunctions, breaks, etc. ina way that it is no longer useful, a secure recovery mechanism may be inplace. This could simply be that the device is quarantined, if it cannotphysically be recovered. Otherwise, the device is returned to themanufacturer or its authorized agent for corrective action or disposal.The manufacturer or its authorized agent may also have policies andprocedures to thwart any cloning or repurposing attempts for systemsthat have reached their end of life.

FIG. 7A further shows the various parties/entities of FIG. 7 includingan operator 154 and devices 150 a, 152. At each step, a STAGEenvironment (200) (described below) is apprised of the currentrelationship between the parties/entities involved. Also note thatmultiple roles may be assumed by the same individual. For instance theinstaller and the operator may in fact be the same person or differentpeople or entities.

In example non-limiting implementations, the system as described can usethe trust bindings to maintain a “chain of custody” of the asset(s)monitored by device 150 a. An example non-limiting chain of custody mayinvolve both a chronological procedure and a logical procedure withtime-based recordkeeping having no gaps or dark or unknown time periods.As one example, consider a climate-controlled refrigerator trucktransporting rare wine. To ensure the provenance of the wine as well asguarantee its condition, it may be desirable to continually monitor andlog the temperature within the container. It may also be desirable tolog when the container is opened, by whom and where. Other conditionsthat might affect the shipment (e.g., vibration, weather, etc.) may alsobe noted. Additionally, the people involved in supervising the shipment(e.g., who packed the shipment, who drove it, and who unpacked it) maybe logged. Secure trust bonds can be formed, substituted and reformed asthe asset is processed and transported. Such provenance and traceabilitymay be important in ensuring the value of the shipment, to assignresponsibility, or for other purposes. Such “chain of custody” may insome example non-limiting implementations be designed to be sufficientlysecure, formal and robust to provide admissible evidence in a courtroomor for other purposes to prove everything that has happened to the assetsince its creation.

Example Non-Limiting Telematics Device Configuration

FIG. 5 shows an example non-limiting schematic diagram of a telematicsdevice 150. In the example shown, telematics device 150 includes amicroprocessor, microcontroller or other programmable ornon-programmable automatic computing or other processing device 180 acoupled to a non-transitory storage device such as FLASH memory 180 bthat stores program instructions that the processor executes to performor provide certain features and/or functions. In one examplenon-limiting implementation, processor 180 a can comprise a conventionallow-power microcontroller that executes program instructions stored inmemory 180 b. However, other configurations including but not limited toFGPA's, embedded logic, digital signal processor(s) or the like are alsopossible.

The functions of telematics device 150 may be determined in part or inwhole by program code or other programming stored in non-volatile memory180 b. In one example non-limiting implementation, additional ordifferent programming including but not limited to scripts may bedynamically downloaded into telematics device 150 and stored in FLASHmemory for execution or other configuration by processor 180 a. FIG. 9shows one example non-limiting operating set for a telematics device,but such operations can be changed dynamically on demand by simplyloading different and/or additional programming and associatedconfiguration information into the device via over-the-air programming(OTAP). The device 150 in one example non-limiting implementationincludes a core immutable code set that upon restart can restore thedevice to a known state to provide self-remediation.

Any type of sensors can be used (infrared, vibration, etc.) or added andconnected to the embedded device. A number of nodes can be created alongthe destination to ensure that all parameters are correct. Scripts canbe downloaded into the embedded device on a dynamic basis based on theinstantaneous context of the asset in real time based on evaluation inreal time of the current state/context of the asset (e.g., GNSSgeofence, but also a wide array of sensor data depending on the usecase). Decisions can be made in the embedded asset device based on astatic PLAN. The asset device dynamically determines whether there arevariances to the static plan and can take appropriate action.

Scripting language allows the end user to be other than the developer. Avisual scripting tool can be used to develop the scripts for executionby the device that is bound to the asset. Visual flowcharting interfaceallows once to develop scripts for the embedded device in the asset. Thescripts can be linked with scheduling so that new scripts can bedownloaded on an as-needed basis. There is no need to download firmwareupdates to provide such dynamic functionality.

In the example shown, telematics device 150 includes a geospatialsensing and/or receiving device such as a conventional GNSS or GPSreceiver that receives geospatial information from geosynchronoussatellites and calculates current position of the device. Other types ofspatial, positioning and/or location devices including but not limitedto geomagnetic sensors, optical sensors or the like may be usedadditionally or alternatively.

In the example shown, telematics device 150 further includes a radiotransceiver 180 d that permits the telematics device to communicateelectromagnetically using conventional telecommunications means such asBluetooth, WiFi, CDMA, TDMA, 3G/4G, GSM, near field communications orany desired data, telephony, radio, data or other communicationsprotocol.

Telematics device 150 may further include an accelerometer 180 e orother vibration, movement, or kinetic sensor or any other sensor.

Telematics device 150 may further include one or a set of opticalindicators or illumination elements 180 f such as a bank of lightemitting diodes. Such optical illuminating elements 180 f can emitvisible light for purposes of communication to a user, and/or infraredor other light for communication with other devices. Additional userinterface input/output devices are possible.

Telematics device 150 may further include a battery 180 g or other powersource to power the components of the telematics device. Such powersource could alternatively include a capacitor, solar cells, near fieldcommunications power supply means, or any other conventional powersupplying arrangement.

Telematics device 150 may further include a connector 180 h forcommunicating using cables or conductors with external devices includingbut not limited to a vehicle bus as described above. In one exampleimplementation, the telematics device 150 is self-configuring tocommunicate with any of a number of desired vehicle or other asset busconfigurations after being connected and listening to traffic andsignaling on the bus.

Example Overall Non-Limiting More Detailed System Architecture

Looking at the FIGS. 6 and 6A, at the core of the TSB/STAGE environment(200) is a database system (240). However the system is designeddifferently than more traditional systems found on the market today. Tounderstand why, one may consider the following problem that is occurringwithin the next 10 years. Currently estimates indicate that there areabout 9 billion devices (150) connected to the Internet. Contrast thatto the more than 7 billion people who living today. And while the numberof people are expected to increase to close to 9 billion in the next %century, the number of devices (150) are estimated to increaseexponentially when compared to the growth rate of the human population.Some organizations are indicating that there will be more than 50billion devices (150) connected to the Internet by the year 2020. Manysources are now calling the next evolutionary step in the growth of theInternet, the “Internet of Things”. These “things” may not only be acomputational devices, the may be also encompass the “asset” thecommunications devices is coupled to.

There likely will not be enough human capital available to install,manage, and/or maintain these devices (150) in the same manner that wedo today. There is a drive to make these devices (150) smarter, and notrely on humans to work harder. However making the devices (150) smartalso comes at a cost. If the estimates suggested are reached, there willbe at least 5 of these smart devices (150) for every man, women, andchild on earth. When contemplating this mass scale of semi-autonomousdevices (150) (e.g., they can follow a set of instructions), one mustalso look back at history. We should also guard against these smartdevices (150) being used for nefarious purposes, unbeknownst to devicesowner/operator, and potentially along with its originally intended use.Simply stated, to effectively achieve some semblance of reliability andmanageability, these devices (150) need to be governed. Therefore it ishighly desirable to design a system to ensure that these devices (150)are operating according to an expected plan, and depending on thedeviation from that plan, can be quarantined and/or potentiallyremediated without human interaction.

The system as depicted in the non-limiting illustrative embodiment ofFIG. 6 was designed to provide such constructs of governance. The systemmay or may not be the custodian for the information being captured orgenerated by these devices (150). However the system retains the dataabout the data, or Meta Data: The who, what, where, when, why, and how.By keeping track of the data about the data, the example non-limitingasset tracking system can provide additional insight into the operationof a device (150). Using the knowledge that devices (150) are very muchlike humans who are creatures of habit, unless some external inputcauses a variance from a given task, they execute within narrow marginsand regiemes. Therefore, by tracking a device's operation against agiven plan, which may be learned over a period of time, and denoting thevariance from this plan, inferences can be made as to the overall healthof a device (150).

As part of this governance, one must also consider the privacy andveracity of the data that is being capture. As indicated previously, theexample non-limiting asset tracking system may or may not be thecustodian of the data being captured, generated, and/or consumed bythese devices (150). To ensure the veracity of the data as well as thedata about the data, a root of trust and chain of custody is maintained.The example non-limiting asset tracking system allows for the entirelife-cycle of these devices 150 to be catalogued, from assembling themolecules into a functional device, to its installation and deployment,to its ultimate demise. In short, the example non-limiting assettracking has the ability to record a device 150's chronological map fromcradle to grave. Given this unique understanding about the device 150,the example non-limiting asset tracking system can potentially(re)instantiate a device 150 to any given point on that map, enablingremediation or cloning of a device to a last known good state.

In more detail, the example non-limiting asset tracking system asdepicted in the non-limiting illustrative embodiment of FIG. 6 is madeup of many components. The devices (150) can be any carbon, biological,or other type of computational resource that can consume, for instance aGPS signal (110) and communicate data over some medium (120). Eachdevice (150) itself may be made up of many sub components or sensorsthat enable the device to consume, capture, and/or generate informationfrom a variety of different sources (humidity, temperature, light,vibration, movement, etc.). The TSB/STAGE environment (200) is at leastthe repository for the Meta Data about the data, and can also be thecustodial repository for the actual data being consumed/generated by adevice (150). The TSB/STAGE is also comprised many sub-components:

The database (240);

A translator service (210) that can communicate with the device in itsgiven tongue (protocol, etc.) and convert the information to anappropriate format that can be processed by the TSB/STAGE system ifnecessary;

A data collector service (220) that interacts with the Meta Data andpotentially the data itself based on the requirements of theowner/operator of the device. The data collector may also implementlogic that aids in determining any variances from the given plan;

An access services interface that enables external entities to inputinto or consume information from the repository such as through webservices interface (230);

Other;

External to the TSB/STAGE (200) environment, other systems provide inputto or consume information from the repository.

A Web Server (600) that enables client systems (800) to view and/orconsume information or Meta Data generated by or about devices (150).This same interface may allow the configuration and/or modification ofthe operation of a device(150) or group of devices (150) under thecontrol of the owner/operator;

A device fulfillment interface that enables manufacturers of devices toregister a device (150) into the TSB/STAGE (200) repository and toinitiate the chain of custody;

A Customer Relations Management interface (500), that enables authorizedindividuals to transfer and track a device (150) from cradle to grave,maintaining a chain of custody;

An external resource interface (700) that enables the TSB/STAGE (200)environment to further correlate the Meta Data and potentially the datasuch as reverse geocoding GPS data via Google Maps API;

Other;

One component of TSB/STAGE (200) system is the data collector service(220). This event driven service is charged with processing the MetaData, and potentially the data that is being generated or consumed bythe devices (150). As part of its functionality it:

Maintains the relationship and chain of custody between manufacturers,owners, operators, customers, retailers, wholesalers, assets/devices(150). In essences all actors, whether they be human or not, thatinteract with the assets/devices through the TSB/STAGE (200) system.

Potentially track the relationship between assets/devices (150) anddefined zones and/or landmarks. The relationship compromises of atleast:

Unknown

In

Out

Other

And may be updated as each event is presented.

Each zone and/or landmark is stored using a geographic vs. geometricshape (circle w/radius, polygon, multi-polygon, etc.) where the exactcurvature of the environment, for instance the earth's surface isfactored into the shape's actual “surface” area.

The relationship is derived from the provided GPS location information(FIG. 6-110).

Track Transitions in the relationship such as In->Out or Out->In cantrigger additional processing (e.g., ingress, egress events).

Track Transitions in the relationship such as Unknown->In|out may nottrigger any additional processing event (ignore) base on governingpolicy for the device.

Potentially compare each location Meta Data item(latitude/longitude/elevation, other coordinate systems, etc.) againstthe zones and/or landmarks records presented to STAGE.

The data collector (FIG. 6: 220) may also provide alerting services toan interested consumer of changes to the relationships defined in theTSB/STAGE (FIG. 6: 200) system. The alerting services allow for thedefinition a policy that a given asset/device should operate within.Based on this policy, any deviation from the expected plan of operationsof a device/asset can then cause the generation of a notification to aspecified consumer. For instance, deviations from the current plan mayinclude, but not limited to:

Speeding (meters/second)->“speed” limit in MPH/KPH with optional“duration”

Battery temp->“temp”

Battery level->“amps”, “ma”

Battery percent->“percent”

Zone entry->zone/landmark record(s)

Zone exit->zone/landmark record(s)

Zone idle->zone/landmark records(s) and “idle” time in minutes or hours

Location entry->zone/landmark records(s)

Location exit->zone/landmark record(s)

Location idle->zone/landmark records(s) and “idle” time in minutes orhours

Other

Each policy definition may have an associated a measurement attributefor items that are measurable (velocity, temperature, power, etc.). Partof this attribute definition has a measurement type preferredpresentation value defined by consumer of the information. For instancea consumer may prefer speed in “KPH” vs. “MPH,” or power in “ma”(milliamps) vs. “a”(amps), or preferred time zone for the presentment ofdate/time information, etc. Each policy entry may contain a list oftarget notification methods, such as data-push to a URL, SMS, and e-mail(SMTP). Along with the method, each policy contains zero or pluraltargets (data-push URL, SMS (phone number), email address, additionalprocessing procedure (e.g., need for further analysis or exceptionhandling), etc. Other notification mechanisms would be apparent to thoseschooled in the art.

As with any items associated with the operation, interaction with,and/or chain of custody of a device/asset, each triggered alertcondition and/or notification is recorded within STAGE.

Other non-limiting architectural features include for example:

Users access TWA (web access)

SWAB: stage web access broker—a serverside layer to broker services toreporting services or web access

Web access: ajax/html/java stored on web server, accessed by the user

The service broker provides secure access

Web access maintains a session about the user before and afterauthentication. Once a user is authenticated, every single request fromweb access is made through the broker to the stage on behalf of thisspecific user. The view of the world is in the context of this specificuser. What does he want to do>What kind of access does he support?

TFF: Fulfillment and TCRM is run by sales force

GEMA: a google set of services is used on the stage side when we areprocessing data and assisting geospatial information

Everything on the user interface is a canvas that can be embedded intoany application

Possible to take the web access and put it anywhere in any customersystem (different entities can use and service this web app)

Branding can be what reseller wants—just a canvas that can be changed insize

As far as the user interface design is concerned:

Everything that is being done in this user interface is done in thecontext of the map

All the data collected in the stage is in the context of geospatialinformation—The application never leaves the map; you always interactwith the map, that is how the data is presented.

Example Non-Limiting Operations Flow

Referring to FIG. 10, the data collection as depicted in thisnon-limiting diagrammatic illustration, starts off at its initializationpoint (1000). Once the data collection system has been started, it is anevent or work request driven process. This allows the system to bereplicated by more than one thread of execution, each waiting for workto be assigned. Upon the presentation of a work item in the datacollection work queue, the data collection thread of execution issignaled (1010). Upon receiving this signal, the thread is processingits work queue to determine if there is any data or Meta Data toprocess. At step 1020 this determination is made. If data is notavailable at this time, the thread of execution returns to step 1010 andsleeps or does other housekeeping tasks waiting for another signal toarrive. If however data is available, at step 1030, the thread fetchesthe first work item from its work queue. Prior to doing any furtherwork, the data collector validates that the information being processedis from a device/asset under its governance. If it is an unknown device,further processing of this work item is terminated the thread ofexecution returns to step 1010.

Assuming that the device/asset has been validated, the data collectorchecks for the presence of GPS information (step 1060). If suchinformation is not available, the thread of execution will advance tostep 1080. If however the appropriate data is present, the thread ofexecution proceeds to step 1070 to reverse geolocate the information. Atthis point the data collector has answered the “who, where, when, how”.

It is to be understood, that the where component may be processed laterif deem necessary by policy or physical limitations apply. For example,consider devices that are not located within range of the traditionalGPS system (Thermosphere, Exosphere, etc.). In many cases reversegeolocation referencing may be delayed until that information is neededfor further processing.

Once the thread of execution has transitioned to step 1080, the raw datacapture process has ended, and the policy enforcement/inference phase isinitiated. Based on the Meta Data collected, and the validity of theidentity, the policy for the given asset/device is referenced. In thenon-limiting exemplary embodiment, at step 1090, alert information isretrieved. If no alert policy information is determined to be available(step 1100), the work item is deemed processed, execution moves to step1180 to remove the item from the work queue. The information is thenadded to the history of the device at step 1190. The thread of executionreturns to step 1010 where it awaits for more work to be presented thatneeds to be processed.

However, if policy information is defined, the thread of executionproceeds to step 1110 to begin further analysis of the data and MetaData (step 1120). Based on the definition of the governance policydefined by the at least one of the owners and operators of thedevice/asset, inferential and comparative analysis is executed upon thepresented data and Meta Data (step 1130). For instance, thedevice/assets speed may exceed previously defined parameter, or the maybe a landmark or zone transition, etc. Any or all of these conditionsoccurred, is occurring, or may occur based on the current and historicaldata and Meta Data available to the data collect. If any of theseconditions cause a transition in the relationship between the device andits associated plan of execution, the data collectors alert system maybe invoked (step 1140). If alerts conditions are satisfied, a record ofthe conditions is generated (step 1150) and the potentially forwarded toany consumer configured to receive such notifications (step 1160). Thismay include the execution of additional inferential or analyticalanalysis. Once all alert conditions have been satisfied (step 1170), thedata collector thread of execution processed to step 1180 to remove thework item from its queue, and transfers any results into is recordedhistory store (step 1190). For sake of brevity, the thread of executionnow returns to step 1010 to await the signaling of additional work. Itis to be understood that additional steps may be taken to analyze thehistorical nature of the data. From this data, an inferential or learnedplan can be determined based on the operation of a device/asset.

It is to be further understood that other steps may be take in the eventthat rogue information is present to the data collector. For instancebase on policy, if at any step during its thread of execution the datacollector determines that the information is invalid or improper, thealert and/or notification subsystem may be called upon to generate anindication to an interested consumer to signal them that a deviation hasoccurred. This philosophy extends through out the entire Examplenon-limiting asset tracking system, which allows for governance byexception, therefore reducing the overall work to be completed by moretraditional management entities.

Additionally, it is to be understood that the steps that are beingdescribed may be subsumed by other components of the TSB/STAGE (FIG.1:200) system. For example, step 1040 may be totally subsumed orcooperatively distributed to a loosely coupled entity known as theManaged Adaptable Trust Engine (MATE). In one non-limiting illustrativeembodiment, the MATE component, in cooperation with the data collectormay assume the responsibility to validate the identity of a given assetand/or device or check the veracity of the data the device/asset isconsuming or generating. This may be accomplished with well knowncryptographic primitives. Other responsibilities may also be delegated.MATE may for instance participate in the root of trust that is createdbetween the asset/device and the TSB/STAGE system, or participate inverifying or augmenting the chain of custody, or in the remediation or(re)instantiation of the given asset/device. MATE's functionality mayalso be distributed, with part coupled to the device and another part atthe TSB/STAGE environment.

Example Non-Limiting User Interface Features

FIGS. 11-40 illustrate various aspects of a graphical user interface inaccordance with the instant disclosure. In an embodiment, the variousgraphical user interface screens illustrated in FIGS. 11-40 may bedisplayed to a user via a computing device equipped with a suitabledisplay. For example, and as illustrated in FIG. 6, the graphical userinterface screens may be presented to a user via a computer (including,but not limited to, desktop computers, laptop computers, handheldcomputers such as tablets, smartphones, etc. or the like) implementing aweb browser. Techniques for displaying graphical user interfaces via aweb browser are well known in the art. As will be appreciated by thosehaving ordinary skill in the art, the graphical user interfacesillustrated in FIGS. 11-40 may be presented using techniques other thana client-server model based web browser, and the instant disclosure isnot limited in this regard.

As noted previously, the system disclosed herein as capable ofgenerating alerts based on a variety of conditions as applied to theassets being tracked. In an embodiment illustrated in FIG. 11, thesevarious alerts may be summarized in a Global Update Tray (GUT) the,thereby permitting the user to quickly develop a sense of the collectivestatus of all assets being tracked. In the exemplary embodimentillustrated in FIG. 11, the GUT comprises a first field, labeled“Alerts” along with a numerical value and a color-coded statusindicator. The numerical value provides an indication of the totalnumber of alerts currently pending for all tracked assets. In theillustrated example, the “Alerts” field shows 40 available alerts alongwith a red status indicator. In one example non-limiting embodiment, theGUT displays the readings from a tracking device relative to pre-setthresholds. For example, threshold values for speed can be set at 65 and75 mph. If the asset is travelling at less than 65 mph the GUT will showgreen. If between 65 and 75 the GUT will show yellow, and if over 75 mphthe GUT will show red. In one example non-limiting implementation, thesesettings may be configured by the user. As further illustrated, the“Alerts” field may include a user-selectable expand/collapse icon(illustrated as an upward-facing triangle) whereby a user may cause thedisplay of more detailed information (illustrated as an “AlertCategories” field) regarding the various alerts. In the illustratedexample, the various alerts include 18 “Speeding” alerts, 12 “Parked”alerts, 4 “Erratic” alerts, etc. Additionally, as shown, each categoryof alerts may include a color-coded status indicator. When the “AlertsCategories” field is displayed, further selection of the expand/collapseicon will cause the “Alerts Categories” field to collapse.

As further illustrated in FIG. 11, other non-alert status indicators maybe provided, as illustrated by the “Inactive”, “Moving”, “Stopped” and“Idle” fields. In these instances, a numerical value indicative of thetotal number of assets meeting the noted status may be displayed.Additionally, a color-coded status indicator may also be provided foreach of these fields. In one example non-limiting implementation, it ispossible to “drill down” into an alert to get more detail. For example,clicking on “alert” shows the types and quantity of alerts such asspeeding, location entry and exit. This too may be configured for auser.

As further shown, an additional user-selectable expand/collapse icon(illustrated as a leftward-facing triangle to the right of theillustrated fields) may be provided, thereby allowing the user to expandand collapse the GUT as desired.

A feature of the disclosed system is the ability to associate specificindividuals with particular objects being tracked. In this context, bothobjects and individuals may be considered “assets.” Graphical userinterfaces for this purpose are further illustrated with reference toFIGS. 12 and 13. In particular, FIG. 13 illustrates a screen whereby auser can add an asset to be tracked. In is noted that, in theillustrated example, object-based assets are presumed to be vehicles.However, the instant system is not limited in this regard and trackedobjects may comprise virtually any object that may have a trackingdevice (described above) attached thereto or associated therewith. Asshown, radio buttons are provided for adding either a “vehicle” or“person” as an asset. As shown in FIG. 13, selection of the “vehicle”radio button causes a number of text boxes and pull-down menus to bedisplayed, thereby permitting relevant information regarding the vehicleto entered. A “name” text box allows a user to enter an identifier forthe vehicle and a “description” text box allows the user to describe thevehicle. Drop-down menus are provided that permit the user to enter atracking device identification as well as a group identification (i.e.,which group of vehicles the added vehicle belongs to). In the event thatthe “person” radio button is selected, a display in accordance with FIG.12 may be provided, whereby a user can enter information regarding auser's identification (name and profile) and contact information.Additionally, similar drop-down menus are provided permitting the personto be associated with a particular tracking device identification aswell as a group identification.

As further illustrated in FIGS. 12 and 13, expandable/collapsible areasmay be provided for the display of individual assets (as shown) orgroups. Likewise, specific users (i.e., persons having permission toaccess the graphical user interface or at least portions thereof) and“geofences” (as described below) may also be displayed in a similarmanner.

Referring now to FIG. 14, a screen is provided whereby individual groupsmay be added or edited. As shown, text boxes are provided permittingusers to enter information regarding a group name, group details (i.e.,a description of the group), identification of a managing user andidentification of specific assets included in the group.

FIG. 15 illustrates a portion of the graphical user interface thatpermits a user to define a so-called “geofence.” As used herein, ageofence is a logical construct describing a boundary that may be usedto generate alerts relative to one or more tracked assets. To this end,as illustrated in FIG. 15, a user is provided with various techniquesfor defining a boundary. Particularly, radio buttons are provided thatallow the user to define the boundary as a “circle”, “rectangle” or“polygon.” A text box is also provided that permits the user to providea name for the geofence. In the case of a “circle” boundary, the usercan provide a specific address via a search text box and further set aradius (via a text box input) around the entered address, therebydefining the geofence as a circle. Although the radius input isillustrated in terms of feet in FIG. 15, it is appreciated that anyconvenient form of measurement may be employed, e.g., miles, kilometers,blocks, etc. Once defined, the circular boundary can be converted intocoordinates that may be used by the system to compare locations ofassets with the boundary, i.e., whether assets are within or outside theboundary, and generate alerts or other data accordingly.

Alternatively, selection of either the “rectangle” or “polygon” radiobuttons enables drawing tools that permit a user to define the boundaryas a simple rectangle or more complicated polygon relative to a map.Drawing tools that permit creation of such shapes are well known in theart and need not be described in detail here. Using known techniques,the boundaries lines defined in this manner may once again be translatedto actual map coordinates.

FIG. 16 illustrates a user interface screen permitting the addition ofnew users. As shown, various text boxes are provided permitting entry ofidentifying and contact information for users of the system.

FIG. 17 illustrates a login page whereby users of the system can enter auser name and password to gain access to the graphical user interface.Because the user interface described herein is, in one embodiment,implemented via password protected web services, the user interface maybe replicated for different entities or organizations such that eachentity or organization is permitted access to only that portion of thesystem data attributable to the entity's or organization's trackedassets. As illustrated in FIGS. 17-41, a “LOGO” may be provided on thevarious user interface screens. That is, the user interface screens maybe customized for a particular entity or organization to include thatentity's or organization's logo or other marketing material.

FIG. 18 illustrates a default user screen once a user has logged intothe system. In particular, the default user interface screen illustrateson a map all of the assets currently associated with the user's entityor organization. As shown, each asset is illustrated by an icon on themap. User-selectable inputs may be provided on the default andsubsequent user interface screens. For example, an “Account Info” optionpermits users to have information displayed about their account; a“Report” option permits the generation of various user-configurable orstatically defined reports; and a “Setting” option permits the user todefine various settings for operation of the system for those assetsassociated with the user's account. For example, the reporting intervalfor the tracking devices associated with the tracked assets can be setvia the “Settings” option.

As further shown in FIGS. 18-35, four main navigational elements areprovided: “Assets”, “Groups”, “Users” and “Geofences.” Alternatively,the navigational elements may arise under different labels. For example,and with particular application to an embodiment in which the system isused to tracked vehicles or the like, the navigational elements may be“Mobile”, “Groups”, “Managers”, “Locations”, and “Zones”. In thisalternative example, the label “Geofences” has been separated into twoseparate navigational elements, i.e., “Locations” and “Zones,” where a“Location” is a particular point, spot , address, coordinate set, etc.whereas a “Zone” defines a wider region, area, locale, etc., where aZone may encompass or be centered on a Location. The number next to eachcategory (e.g., Assets 10, Groups 3, etc.) illustrates the number ofseparate records for each category. The expand/collapse icon(right-facing triangle) shown next to each of the main navigationalelement permits the user to display a panel for that category, therebydisplaying context-dependent information for that category. In turn, the“+” symbol next to each navigation element permits the user to add tothe corresponding category, e.g., to add a new asset, group, user orgeofence via the user interface screens described above.

By selecting any individual asset icon displayed on the map, forexample, by using a user input selection device such as a mouse(“clicking”, “hovering”, “double clicking”, etc. as known in the art), alabel for the selected asset is shown, which label may be subsequentlydismissed by selection of the “X” symbol within the label.Alternatively, the user may further select the asset label to focus thedisplayed map (which may be provided using any mapping service, such asGoogle Maps) on the selected asset. This is further illustrated in FIG.19 where the “Asset” panel has been expanded and the asset label hasalso been expanded to display additional information about the selectedasset. As shown, the expanded “Assets” panel includes a search input boxthat permits a user to search for specific assets, as well as text inputbox that permits the user to filter which assets are displayed in thepanel according to specific groups. Additionally, selectable options areprovided that permit the sorting of the displayed assets within thepanel according to asset names or the number of alerts for each asset.Much like clicking on an asset icon displayed on the map causes the mapto focus on the selected asset and display a corresponding label,selection of an asset within the “Assets” panel cause the map to focuson the selected asset and to display a corresponding asset label.Hovering over an asset selected in the panel causes an edit icon(illustrated, in this example, as a pencil) to be displayed; selectionof the edit icon permits the user to edit information specific to theselected icon.

FIGS. 21 and 22 illustrate alternative embodiment of an user interfacescreen resulting from selection of the edit icon for a given asset. Asshown, FIG. 21 is substantially similar to the user interface screenillustrated in FIGS. 12 and 13, with the exception that the user is notpermitted to select another asset (i.e., a person) from this screen.Additionally, the edit screens of FIGS. 21 and 22 illustrateuser-selectable options for changing or uploading an image, as describedbelow, to be displayed whenever the asset is selected on the userinterface.

Referring once again to FIG. 19, within the asset label displayed on themap, basic information about the selected asset is displayed, e.g., itsgroup name, manager, current status, location and/or speed. A region(illustrated as a rectangular are in the upper left corner of the labelin FIG. 19) is provided that may be used to display a photo or otherimage representative of the selected asset. A “Breadcrumb” selectableoption is also provided. As known in the art, a “breadcrumb” display isan illustration of all of the recent location data for the asset, suchthat the user is provided with insight as to the recent travels of theasset. In an embodiment, selection of the “Breadcrumb” option causes theasset label overlay to be removed in favor of the breadcrumb display. Anexample of this is illustrated in FIG. 35 where a breadcrumb trail of“asset c” is illustrated by the red path and green directional arrows.As further shown in FIG. 35, selection of any one of the directionarrows causes the display of an overlay including data for the assetcorresponding to a particular point in time, including, for example, thedirection, location, speed, etc. of the asset.

Referring once again to FIG. 19, the asset label may include selectable“Alert” indication. Selection of the “Alert” indication within the assetlabel of FIG. 19 causes the asset label to expand to show any alertscurrently available relative to the selected asset, as shown in FIG. 20.In an embodiment, the available alerts are listed chronologically frommost recent to least recent, with a scroll bar further provided ifnecessary. For example, as illustrated in FIG. 20, each of the alertsfor “asset c” relate to the entry or exit of that asset relative to“geofence1.” Although not illustrated in FIG. 20, an option may beprovided whereby individual alerts may be dismissed by the user, wherebythe dismissed alert is no longer displayed (although not deleted fromthe system database).

Referring now to FIG. 23, a user interface screen resulting fromselection of the “Groups” navigation element is further illustrated. Inthe illustrated example, three groups are displayed within the resulting“Groups” panel. Further selection of one of the groups, e.g., the “Zone2” group, causes the map display to be updated to display only thoseassets belonging to the “Zone 2” group. Once again, hovering over agroup in the panel will cause an edit icon to be displayed, wherebyedits to the selected group may be entered. Selection of the edit iconcauses a group edit screen as shown in FIG. 24 to be displayed. Thegroup edit screen of FIG. 24 is substantially similar to that shown inFIG. 14, with the exception that assets to be added to the group may beidentified using a scrollable window listing assets available to beadded to the group.

FIGS. 25-27 provide more details of how assets are managed in groups.

Referring now to FIG. 28, a user interface screen resulting fromselection of the “Users” navigation element is further illustrated. Inthe illustrated example, two users (or mangers) are displayed within theresulting “Users” panel. Further selection of one of the users, e.g.,the “Michael Manager” user, causes information about that user to bedisplayed. As described previously, hovering over any of the listedusers causes an edit icon to be displayed. In the example shown, achange password dialogue box is illustrated. As further shown, a“Groups” option is available whereby groups associated with the selecteduser can be modified. In particular, selection of the “Groups” optioncauses the display of the screen illustrated in FIG. 29, where a searchbox is provided permitting searching of available groups. As furthershown in FIG. 29, available groups and corresponding descriptions may bedisplayed. Check boxes next to each displayed group permits the selectedgroups to thereafter be associated with the selected user.

Referring now to FIG. 30, a user interface screen resulting fromselection of the “Geofence” navigation element is further illustrated.In the illustrated example, 15 previously-defined geofences aredisplayed within the resulting “Geofence” panel. As shown, a scroll barmay be supplied thereby allowing the user to view all of the availablegeofences. Selection of a specific geofence within the panel cause themap display to be focused on and display the boundaries defined by theselected geofence. For example, as illustrated in FIG. 30, the selectedgeofence “geofence5” is illustrated as a circle on the map. Once again,hovering over a geofence entry in the panel will cause an edit icon tobe displayed, whereby edits to the selected geofence may be entered.Selection of the edit icon causes a geofence edit screen as shown inFIG. 31 to be displayed. The geofence edit screen of FIG. 31 comprisesfunctionality substantially similar to that described above relative toFIG. 15. When the geofence edit screen is displayed, it defaults to theoriginal style of the selected geofence, i.e., because “geofence5” inFIG. 30 is defined as a circle, the geofence edit screen of FIG. 31defaults to those inputs available for editing a circular geofence.However, as further illustrated in FIGS. 32 and 33, editing of ageofence may include redefining the geofence as a rectangular orpolygonal geofence using the relevant radio buttons.

FIGS. 35 and 36 illustrate alternative embodiments of user interfacescreens for editing information regarding a person-type asset. Theembodiments illustrated in FIGS. 35 and 36 are substantially similar tothe embodiment illustrated in FIG. 12 and described above, with theexception that FIGS. 35 and 36 include user input options permitting themodification and/or uploading of an image to be displayed whenever theasset in question is displayed on a map display.

FIGS. 37-40 illustrate screens that may be used by a user to purchase asubscription for one or more tracking devices. As shown in FIG. 37, auser may enter a quantity of each type of subscription desired and thenproceed to a checkout screens, as illustrated in FIGS. 38 and 39, wherethe user can enter payment information to complete the transaction.Thereafter, a transaction confirmation screen, as illustrated in FIG.40, may be provided.

The above user interfaces have thus been designed so that they renderitself automatically based on the facts being collected. This makes theuser interface extensible. The characterization of the facts are laidout in table—so it is possible add a new alert by adding a new tableentry. Alerts are at the server level and/or at the device layer. Thetranslator will transmit new fact information, which gets stored as aunit of measure for this fact. The user can set up its own preferencefor what they want to see in this fact. Then, the new fact informationmay become a triggerpoint for the fact itself. Fairly definable featuresmay be based on the “create alert” user input screen.

The user interface tells at a glance whether the fleet is moving or not(red means fleet is not moving enough). These indicators are allactionable. Which ones do I reward for moving? The system administratoror dispatcher can figure out which assets are which, and can take actionfrom that. The system is absolutely configurable. By configuring thealerts, it is possible to automatically configure a new geospatialmapping interface.

Example Non-limiting Architectures for Trusted Execution and Delegation

FIG. 41 illustrates an example non-limiting architecture for TrustedExecution and Delegation. Leveraging a trusted execution environment isin one example non-limiting embodiment comprised of (2) the trust rootand engine, combined with (1) trusted applications. Using suchcombination it is possible to delegate the use of processing andresources from one trusted application to another.

The FIG. 41 diagram depicts trusted applications running on the samedevice. Leveraging digital signatures with included rules, applicationsmay be resident on separate physical devices for example if digitalsignature verification is accomplished within the same key space. Inthis way, it is possible for one trusted application to “delegate”authority for a task to another trusted application if it has both thecapabilities and authority to do so.

For example, if App(1) and App(2) are authorized to and capable ofmaking cellular data calls, and App(1) is not able to transmit data onschedule, it can delegate this function to App(2).

Delegation is accomplished in some non-limiting embodiments on aconfigurable time and/or usage basis and may be for one time, for aspecific number of times, until a particular end date/time orpermanently.

Trusted Applications in this example non-limiting context may beapplications that have: a) a published set of capabilities that arepublished on the Trust Bus (5); b) a set of rules governing thecapabilities of the application; and c) a digital signature that ensuresintegrity of the application, its published capabilities and rules whiledemonstrating authenticity of the issuance of the application.

Trusted Root and Engine provide on demand highly secure processing andgoverned access to input/output devices attached to the device. TrustedApplications (1) are able to call on the more secure functions.

The example non-limiting application provides access logic and apublishing model for capabilities. These published capabilities, and theauthority to run are verified by the App Interpreter (4). The appinterpreter runs in a protected memory partition setup by the trust bus(5).

The App Interpreter (4) verifies the application's digital signature,rules, capabilities and formats to a common format for all appinterpreters on the Trust Bus (5) to have a common modeling language forcapabilities and rules based permissions. App Interpreters run withinpartitioned memory as defined by the Memory Control Unit (MCU). Oneexample non-limiting mechanism is to use a hypervisor to provide themapping and governance functions for volatile memory ensuring sensitive“app interpreter” and “trust bus” operations cannot be observed ormodified by unauthorized software.

The example non-limiting Trust Bus (5) runs in partitioned memoryprotected from unauthorized applications. In some example non-limitingembodiments, only “app interpreters” are authorized to add, delete,modify to mappings in the Trust Bus. The Trust Bus publishescapabilities of applications, maintains their associations with hardwareI/O (9), and determines the outcome of delegation requests.

The Brokered Services Interface (BSI) (6) in this non-limitingembodiment is software that enhances traditional Remote Procedure Call(RPC) protocols by including event driven triggers, and enables securecommunications between the Trusted Processor (8) and the Trust Bus (5).

Trusted storage (7) provides protected on-chip storage for to maintainintegrity if sensitive data items and ensuring secrets are not revealedoutside the protective boundary.

The trusted processor (8) runs a trusted OS of known good software,verified at boot using a certificate and has dedicated volatile memoryfor sensitive operations to be protected from reading or changes.

The Trusted I/O Bus (9) is software that receives all read and writerequests to devices connected to the Bus. It validates read and writeattempts and verifies validity by verifying the digital signature. Whilethis architecture requires the additional overhead of verifying all readand write requests, it can be made more efficient using symmetric keyHMACs. This example non-limiting architecture that enables delegationbetween different applications.

FIG. 42 is an example non-limiting illustration of delegation betweenseparate devices that share the same cryptographic key space. The TrustBus is virtually extended over the wireless link. Thereafter alloperations act the same as if when App(1) resided on the same PrintedCircuit Board (PCB) as in FIG. 41.

This example non-limiting architecture enables the physical separationof devices that are logically part of the same secure logical device.This architecture in turn enables “remediation”.

In the case where a device is found to be operating outside ofprescribed limits, or there is a belief that the device is compromised,it is possible to create a connection—wired or wireless—to a conformantdevice. The conformant device is able to either reflash the device withtrusted software and/or update keys in the Trust Engine.

Remediation may also be performed remotely over cellular or satelliteconnection. Remediation in some example non-limiting embodiments isbearer agnostic.

NON-LIMITING EXAMPLES Example I

In one example non-limiting implementation, every interaction done withthe map is centered around a particular location including an elevation.The system can inform people about exceptions that they are interestedin, for example: A time of idle, or a lengthy stop. The environment andinterests of the user varies depending on the particular case. Forexample, some may wish to monitor threats to safety for example of thedriver, the asset or environment. Others may be interested in themaintenance of vehicle or machinery. Some may be in interested inproductivity. The system is configurable to configure what alerts aparticular user wants. Different devices 150 can collect different typesof data/facts, and extensible devices can collect facts that currentdesigners are not thinking about today. The system is able to configurealerts for those new facts. Design and application allows the system toaccept new set of facts and based on the data we can store the data inthe STAGE database 200, and the user interface will automatically allowa user to configure an alert based on those new facts (for example, Iwant to know about speeding for a certain amount of time). The speed andthe time gap will be captured to define speeding, and which zones orwhich locations are ones of interested can be used to define the zonelocations. If an asset's engine is overheating, it is possible toconfigure the temperature the engine should be operated at. Biometricdata is also collected. The challenge is solved herein by the userinterface: when the alert type is “location entry” the user selectswhich entry he is interested in. This fact of location has beendescribed in the location database. When the user switches it tospeeding, what is collected may change to speed and time. The examplenon-limiting user interface has been designed so that it renders itselfautomatically based on the facts being collected. This makes the userinterface extensible. As discussed above, the characterization of thefacts are laid out in tables in one example implementation, so it ispossible to add a new alert by adding a new table entry.

The TCOMM and TCOMM database (communication component) uses a standardoff the shelf content management system employed as a publishingprocess. A published page goes from private draft to public page. We canassign roles to various people who can do whatever they wish in thepublishing process. We can then empower someone else to authorizepublication. We can operate the system with any other environment.Different dealers or other users can use their own rebranded version.

Example II Mobile Install App

Installation and getting things set up in vehicle on a rollout is wheremost of the initial work is.Installation/provisioning/activation—enrollment mobile app is performedallowing access to the solution via a smart phone or other user device.Provisioning and installation data collection and management providessimple processes for installing telematics devices 150. For example,asset name, mileage, condition and other information is collected andput into the database. Generally in the past, people would fill out apaper form and then handkey this information in. One examplenon-limiting implementation makes this electronic and just in time. Anaccount's administrator (owner) mobile extension of the web interface isused for this purpose. We also have a mobile user extension so they canuse their smart phone or other interface device to access informationfrom the device.

A smart phone app is provided to manage an install. This allows theowner to have a management tool to self-manage the installation. Theclient purchasing the system can use this installation app on thesmartphone to manage the installation. The app takes the field datarelated to installation and provides it for incorporation into thedatabase. The device can take a picture of a 2D symbol, or use Bluetoothto access the device, or type in an identification for the device. Theinstaller can provide authorization based on serial numbers associatedwith the installation job. Meanwhile, the mobile device can obtainvarious information including the VIN from the vehicle itself. However,this does not indicate the tag number or other more commonly-usedidentifiers for the asset, which can be inputted in addition. Therefore,some additional data entry may be inputted upon installation to ensurethe mobile device is properly bound with the vehicle or other asset.

Smaller fleets (e.g., less than 100 mobile employees) do not necessarilyhave a dedicated installer. This tool allows smaller customers and otherusers to “do it yourself” without professional installer support andassociated expense.

Example III Profile User Interfaces

In one example non-limiting implementation, there are two differenttypes of user interfaces: the owner and the worker. These two classes ofusers have different objectives and may have different technical andother capabilities and interests.

A field service company example may be a plumbing company. Theircustomer has a plumbing emergency. They call the plumbing company, whosends a job request out to the field to dispatch a field servicerepresentative. The system allows the dispatcher to track the fieldservice representative as they travel to the house via GPS tracking.There are also other aspects such as time keeping, collaboration,submitting bid and accepting bids in real time.

The example non-limiting system provides for transparent field data tobe sent to the cloud (peer to peer, peer to host). It also providestools to improve productivity and performance anywhere for any approvedusers. Decisions and adjustments can be made in real time.

The owner of the business can have their own applications to set up.Such functions manage personnel (e.g., creating, adding, editing anddeleting workers). This also permits personnel management by viewing abreadcrumb trail, set exception triggers, ping workers, get real-timestatus, find nearest, view workers on a map, etc. Installation tokenscan be issued on provisioning or issuance of a ticket. This also allowsschedule and dispatch to assign an installer to do the installs, monitorwork progress, etc. This provides an active engaged environment so theowner knows exactly what is happening when and can see it updating andunfolding online.

Most owners of small businesses are busy and out in the fieldthemselves. They can perform configuration and monitoring on their ownsmartphone or other mobile interface.

The worker's screen is a different user interface in an examplenon-limiting implementation. A particular worker is bound to theelectronic device in the vehicle or other asset to thereby assign adriver to a particular vehicle via a smart phone. The workers can alsosee who else is in the field and where their reports are (if they are asupervisor for example). Work management has the need for dispatch andwork assignments. Such scheduling and dispatch confirms arrival locationat the customer location. The worker can report what they are doing inreal time with their smartphone.

The third party installer can become a worker during the install, andcan be tracked by the system. This enables the third party to be trackedand to track.

When you marry a smartphone with an installed device, there is loggingassociated with that. It is possible to synchronize and link, using aBluetooth interface, the user with the device.

Worker functions include entering worker information such as byproviding a token for install. A smart phone application can bedownloaded, and the device can be synchronized for provisioning.Individual driver assignments can be provided for the mobile device andmobile interface device synchronization. Users can be granted access tothe mobile device user interface.

Mobile applications can be used to integrate GPS tracking with workmanagement and remote collaboration. GPS tracking is one piece of thesolution. The application on the mobile device can provide additionalfunctionality to the worker. Workflow control can be provided by such amobile app. Location, communication and back office functions are allsupported in an integrated manner.

While the technology herein has been described in connection withexemplary illustrative non-limiting embodiments, the invention is not tobe limited by the disclosure. The invention is intended to be defined bythe claims and to cover all corresponding and equivalent arrangementswhether or not specifically disclosed herein.

We claim:
 1. Apparatus for associating with an item, comprising: aprocessor disposed and structured to receive inputs from at least onesensor; and a non-transitory memory device storing instructions thatwhen executed by the processor provide a trust engine that automaticallysecurely maintains a trusted chain of custody with respect to activitiesassociated with delivery of people, products and/or services.
 2. Theapparatus of claim 1 further comprising a housing that is bound to anasset, wherein the processor and the trust engine it implements isdisposed in the housing.
 3. The apparatus of claim 1 wherein the memorydevice stores further instructions that when executed by the processorsecurely manages and executes downloadable applications.
 4. Theapparatus of claim 1 wherein the at least one sensor comprises ageographical locating sensor.
 5. The apparatus of claim 1 wherein the atleast one sensor comprises a biometrics sensor.
 6. The apparatus ofclaim 1 wherein the processor is structured to securely receive inputsfrom the at least one sensor over a wireless link.
 7. The apparatus ofclaim 1 wherein the processor is structured to securely authenticate andbind with an additional, portable device providing said at least onesensor.
 8. The apparatus of claim 1 wherein the processor is structuredto receive inputs wirelessly from the at least one sensor disposed in ahandheld device.
 9. The apparatus of claim 1 wherein the trust engine isstructured to be securely managed and monitored remotely.
 10. Theapparatus of claim 1 wherein the trust engine is structured to executesecure intelligent agents of a remotely located management entity.
 11. Asystem for cooperating with a user having a user device, the systemcomprising: a sensor that monitors an asset; at least one intelligentcommunicating device configured to provide a trusted intelligent agentthat gathers information from the sensor; the system being furthercomprising binding (a) the user to the user device, (b) the user deviceto intelligent communicating device, and (c) the user and theintelligent communicating device.
 12. The system of claim 11 wherein thesystem uses plural intelligent communicating devices to bind asset toasset.
 13. The system of claim 11 wherein the intelligent communicatingdevice enables the system to continually monitor location andinteractions, including chain of custody, of the asset over time. 14.The system of claim 11 wherein the system provides binding based onproximity.
 15. The system of claim 11 wherein the user's device includesa sensor that the system uses to create a trust bond with theintelligent communicating device.
 16. The system of claim 11 wherein theintelligent communicating device is configured to be remotely securelydynamically updated/maintained/extended.
 17. The system of claim 11wherein the user device comprises a conventional smartphone or otherhandheld user device providing a user interface capability, and theintelligent communicating device employs the handheld user device userinterface capability to interface with the user.
 18. The system of claim11 wherein the intelligent communicating device provides a root of trustwithin an integrated circuit chip which prevalidates a softwareenvironment before starting up.
 19. The system of claim 11 wherein theintelligent communicating device provides a trusted environment and oncethe trusted environment is operational, the system continually validatesthe trusted environment for health and sanity.
 20. The system of claim19 wherein if the system determines the intelligent communicating deviceis not acting in accordance with a prescribed healthy device, the systemquarantines the intelligent communicating device and then remediates theintelligent communicating device by a side channel that can bereinitialized in accordance with secure mechanism to bring theintelligent communicating device back to life.
 21. The system of claim11 wherein the system transforms a defensive node into an offensive modethat can be used to disrupt an existing infrastructure.
 22. The systemof claim 11 wherein the system uses frequency analysis and correlationon an engine or class of engines, based on rpm and other attributes,which may be correlated to vehicle OBD codes.
 23. The system of claim 11wherein the system dynamically defines behavior of the intelligentcommunicating device based on a set of facts from an asset to define anagent that is going to take an action, and uses historical data togenerate an alert to detect variance between planned and actualactivities.
 24. The system of claim 11 wherein the intelligentcommunicating device is hardware mechanically fixable to the asset, or asecure software entity that is authenticated to a user, the assetcomprises a container used to deliver people/products/services, and theintelligent communicating device monitors the geolocation, operationand/or condition of the asset and/or biometrics of the user.